GANerated Hands for Real-time 3D Hand Tracking from Monocular RGB

We address the highly challenging problem of real-time 3D hand tracking based on a monocular RGB-only sequence. Our tracking method combines a convolutional neural network with a kinematic 3D hand model, such that it generalizes well to unseen data, is robust to occlusions and varying camera viewpoints, and leads to anatomically plausible as well as temporally smooth hand motions. For training our CNN we propose a novel approach for the synthetic generation of training data that is based on a geometrically consistent image-to-image translation network. To be more specific, we use a neural network that translates synthetic images to "real" images, such that the so-generated images follow the same statistical distribution as real-world hand images. For training this translation network we combine an adversarial loss and a cycle-consistency loss with a geometric consistency loss in order to preserve geometric properties (such as hand pose) during translation. We demonstrate that our hand tracking system outperforms the current state-of-the-art on challenging RGB-only footage

Single-Shot Multi-Person 3D Pose Estimation From Monocular RGB

We propose a new single-shot method for multi-person 3D pose estimation in general scenes from a monocular RGB camera. Our approach uses novel occlusion-robust pose-maps (ORPM) which enable full body pose inference even under strong partial occlusions by other people and objects in the scene. ORPM outputs a fixed number of maps which encode the 3D joint locations of all people in the scene. Body part associations allow us to infer 3D pose for an arbitrary number of people without explicit bounding box prediction. To train our approach we introduce MuCo-3DHP, the first large scale training data set showing real images of sophisticated multi-person interactions and occlusions. We synthesize a large corpus of multi-person images by compositing images of individual people (with ground truth from mutli-view performance capture). We evaluate our method on our new challenging 3D annotated multi-person test set MuPoTs-3D where we achieve state-of-the-art performance. To further stimulate research in multi-person 3D pose estimation, we will make our new datasets, and associated code publicly available for research purposes.Comment: International Conference on 3D Vision (3DV), 201

DETERMINATION OF OPTIMUM OF CAPITAL-LABOUR RATIO WITHIN TWO-FACTOR PRODUCTION FUNCTIONS WITH NON-ZERO SUBSTITUTION BY THE PRINCIPLE OF EQUAL MARGIN

Theoretical and applying aspects of using the principle of equal margin in microeconomics for the determination of the optimal capital-labour ratio within two-factor production functions with non-zero substitution are discussed. The use of the proposed algorithm is carried out on the example of such production functions as Cobb-Douglas function, linear, Leontief function, which are generalized by a function with constant elasticity of the substitution of factors. The purpose of this article is to offer a fairly simple opportunity for the economicmathematical determination of optimal capital-labour ratio within two-factor production functions with the non-zero substitution of resources on the basis of the principle of equal margin. Justified the principle of equal margin for the determination of optimal capital-labour ratio within two-factor production functions with nonzero substitution. The results of the study show that there are possibilities of the proposed approach to the analysis of extreme interconnections between production and aggregate factors of production. Practical recommendations on the application of these production functions in the process of econometric modelling and forecasting are given.Theoretical and applying aspects of using the principle of equal margin in microeconomics for the determination of the optimal capital-labour ratio within two-factor production functions with non-zero substitution are discussed. The use of the proposed algorithm is carried out on the example of such production functions as Cobb-Douglas function, linear, Leontief function, which are generalized by a function with constant elasticity of the substitution of factors. The purpose of this article is to offer a fairly simple opportunity for the economicmathematical determination of optimal capital-labour ratio within two-factor production functions with the non-zero substitution of resources on the basis of the principle of equal margin. Justified the principle of equal margin for the determination of optimal capital-labour ratio within two-factor production functions with nonzero substitution. The results of the study show that there are possibilities of the proposed approach to the analysis of extreme interconnections between production and aggregate factors of production. Practical recommendations on the application of these production functions in the process of econometric modelling and forecasting are given.Theoretical and applying aspects of using the principle of equal margin in microeconomics for the determination of the optimal capital-labour ratio within two-factor production functions with non-zero substitution are discussed. The use of the proposed algorithm is carried out on the example of such production functions as Cobb-Douglas function, linear, Leontief function, which are generalized by a function with constant elasticity of the substitution of factors. The purpose of this article is to offer a fairly simple opportunity for the economicmathematical determination of optimal capital-labour ratio within two-factor production functions with the non-zero substitution of resources on the basis of the principle of equal margin. Justified the principle of equal margin for the determination of optimal capital-labour ratio within two-factor production functions with nonzero substitution. The results of the study show that there are possibilities of the proposed approach to the analysis of extreme interconnections between production and aggregate factors of production. Practical recommendations on the application of these production functions in the process of econometric modelling and forecasting are given.Theoretical and applying aspects of using the principle of equal margin in microeconomics for the determination of the optimal capital-labour ratio within two-factor production functions with non-zero substitution are discussed. The use of the proposed algorithm is carried out on the example of such production functions as Cobb-Douglas function, linear, Leontief function, which are generalized by a function with constant elasticity of the substitution of factors. The purpose of this article is to offer a fairly simple opportunity for the economicmathematical determination of optimal capital-labour ratio within two-factor production functions with the non-zero substitution of resources on the basis of the principle of equal margin. Justified the principle of equal margin for the determination of optimal capital-labour ratio within two-factor production functions with nonzero substitution. The results of the study show that there are possibilities of the proposed approach to the analysis of extreme interconnections between production and aggregate factors of production. Practical recommendations on the application of these production functions in the process of econometric modelling and forecasting are given.Theoretical and applying aspects of using the principle of equal margin in microeconomics for the determination of the optimal capital-labour ratio within two-factor production functions with non-zero substitution are discussed. The use of the proposed algorithm is carried out on the example of such production functions as Cobb-Douglas function, linear, Leontief function, which are generalized by a function with constant elasticity of the substitution of factors. The purpose of this article is to offer a fairly simple opportunity for the economicmathematical determination of optimal capital-labour ratio within two-factor production functions with the non-zero substitution of resources on the basis of the principle of equal margin. Justified the principle of equal margin for the determination of optimal capital-labour ratio within two-factor production functions with nonzero substitution. The results of the study show that there are possibilities of the proposed approach to the analysis of extreme interconnections between production and aggregate factors of production. Practical recommendations on the application of these production functions in the process of econometric modelling and forecasting are given.Theoretical and applying aspects of using the principle of equal margin in microeconomics for the determination of the optimal capital-labour ratio within two-factor production functions with non-zero substitution are discussed. The use of the proposed algorithm is carried out on the example of such production functions as Cobb-Douglas function, linear, Leontief function, which are generalized by a function with constant elasticity of the substitution of factors. The purpose of this article is to offer a fairly simple opportunity for the economicmathematical determination of optimal capital-labour ratio within two-factor production functions with the non-zero substitution of resources on the basis of the principle of equal margin. Justified the principle of equal margin for the determination of optimal capital-labour ratio within two-factor production functions with nonzero substitution. The results of the study show that there are possibilities of the proposed approach to the analysis of extreme interconnections between production and aggregate factors of production. Practical recommendations on the application of these production functions in the process of econometric modelling and forecasting are given.Theoretical and applying aspects of using the principle of equal margin in microeconomics for the determination of the optimal capital-labour ratio within two-factor production functions with non-zero substitution are discussed. The use of the proposed algorithm is carried out on the example of such production functions as Cobb-Douglas function, linear, Leontief function, which are generalized by a function with constant elasticity of the substitution of factors. The purpose of this article is to offer a fairly simple opportunity for the economicmathematical determination of optimal capital-labour ratio within two-factor production functions with the non-zero substitution of resources on the basis of the principle of equal margin. Justified the principle of equal margin for the determination of optimal capital-labour ratio within two-factor production functions with nonzero substitution. The results of the study show that there are possibilities of the proposed approach to the analysis of extreme interconnections between production and aggregate factors of production. Practical recommendations on the application of these production functions in the process of econometric modelling and forecasting are given.Theoretical and applying aspects of using the principle of equal margin in microeconomics for the determination of the optimal capital-labour ratio within two-factor production functions with non-zero substitution are discussed. The use of the proposed algorithm is carried out on the example of such production functions as Cobb-Douglas function, linear, Leontief function, which are generalized by a function with constant elasticity of the substitution of factors. The purpose of this article is to offer a fairly simple opportunity for the economicmathematical determination of optimal capital-labour ratio within two-factor production functions with the non-zero substitution of resources on the basis of the principle of equal margin. Justified the principle of equal margin for the determination of optimal capital-labour ratio within two-factor production functions with nonzero substitution. The results of the study show that there are possibilities of the proposed approach to the analysis of extreme interconnections between production and aggregate factors of production. Practical recommendations on the application of these production functions in the process of econometric modelling and forecasting are given

VNect: Real-time 3D Human Pose Estimation with a Single RGB Camera

We present the first real-time method to capture the full global 3D skeletal pose of a human in a stable, temporally consistent manner using a single RGB camera. Our method combines a new convolutional neural network (CNN) based pose regressor with kinematic skeleton fitting. Our novel fully-convolutional pose formulation regresses 2D and 3D joint positions jointly in real time and does not require tightly cropped input frames. A real-time kinematic skeleton fitting method uses the CNN output to yield temporally stable 3D global pose reconstructions on the basis of a coherent kinematic skeleton. This makes our approach the first monocular RGB method usable in real-time applications such as 3D character control---thus far, the only monocular methods for such applications employed specialized RGB-D cameras. Our method's accuracy is quantitatively on par with the best offline 3D monocular RGB pose estimation methods. Our results are qualitatively comparable to, and sometimes better than, results from monocular RGB-D approaches, such as the Kinect. However, we show that our approach is more broadly applicable than RGB-D solutions, i.e. it works for outdoor scenes, community videos, and low quality commodity RGB cameras.Comment: Accepted to SIGGRAPH 201

XNect: Real-time Multi-Person 3D Motion Capture with a Single RGB Camera

We present a real-time approach for multi-person 3D motion capture at over 30 fps using a single RGB camera. It operates successfully in generic scenes which may contain occlusions by objects and by other people. Our method operates in subsequent stages. The first stage is a convolutional neural network (CNN) that estimates 2D and 3D pose features along with identity assignments for all visible joints of all individuals.We contribute a new architecture for this CNN, called SelecSLS Net, that uses novel selective long and short range skip connections to improve the information flow allowing for a drastically faster network without compromising accuracy. In the second stage, a fully connected neural network turns the possibly partial (on account of occlusion) 2Dpose and 3Dpose features for each subject into a complete 3Dpose estimate per individual. The third stage applies space-time skeletal model fitting to the predicted 2D and 3D pose per subject to further reconcile the 2D and 3D pose, and enforce temporal coherence. Our method returns the full skeletal pose in joint angles for each subject. This is a further key distinction from previous work that do not produce joint angle results of a coherent skeleton in real time for multi-person scenes. The proposed system runs on consumer hardware at a previously unseen speed of more than 30 fps given 512x320 images as input while achieving state-of-the-art accuracy, which we will demonstrate on a range of challenging real-world scenes.Comment: To appear in ACM Transactions on Graphics (SIGGRAPH) 202